TAKING 
KILLZONE 
SHADUW FALL 


IMAGE QUALITY INTO THE NEXT GENERATION 


Michal Valient / Lead Tech / Guerrilla Games 
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- Look back at the developn lent 9) t Killz 
What is the Next- Gen look? 
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KILLZONE SHADOW FALL BACKGROUND 


· New platform 

· Hardware under development 

· Difficult to define scope of the game 

· Мо PC fallback for the engine 

· Features in development throughout production 
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FALL BACKGROUND 


KILLZONE SHADC 


. Launch title | 
. Unmovable release date «У 
. Limited time for experiments 
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APRIL 2012 - THE PATRIOT / МОСКИР 


OCTOBER 2012 = ІНЕ 


February 2013 - Ihe Patriot / Announcement Demo 
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KILLZONE SHADOW!FALE IN NUMBERS 


we 


9 . 
Y \ PTS 
"ОХ ~ % 
е nb » ( € 


OUR LEVELS LREW ВІССЕ 


= 


TREE М 


У Ара; 
e ря те Ave. 
23 Wr y ù \ 


E | DA 
E 
Х Te A ar 
Ё z E. 
" | «t 
У У ÁT 
~ i 
- 


m. 
"ак. 
4 
N 


· Levels 10 to 100 times larger than in Killzone 3 
· Largest map 15 almost 8km long 

. We don't have open world engine 

. First time we ran into precision Issues X 
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. Doubled the amount ої geometry instances 
. 10,000 to 25,000 per level section 
. One instala, I= one arag call 
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· Early guideline that worked 
‚ 40,000 triangles per character 
. Complicated shader networks 
‚ 6-12 textures per material 
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ЕМСІМЕ 4.0 
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гопе Shadow Fall defining tech features 
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LIGHTING - THE GUERRILLA WAY 


. All aspects of lighting complement each other 
. BRDF 


Assets EMEN ЈИ 
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LIGHTING - THE GUERRILLA WAY 


· Physically based lighting model 
. Artist controllable 
· Assets reviewed іп in-game па поје environments 


Also integrated | in Maya Ath 
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LIGHTING - THE GUERRILLA WAY 


All lights are area lights 
. Including textured lights 
. Consistent specular response 
. eunlight 
. Volumetric 
. More details in GPU Pro 5 


Killzone Shadow Fall / GDC 2014 


) 


23%? 
се ai 
a 
erg 
2% 4. 


+ T 
TUN Аи 
v 


X “ 4 
s УУ 18468 


62] СЕ 


б». 


зіва 


Us ТЕ] 
N one Shade Fali JDC 2014 


INDIRECT LIGHTING 


INDIRECT LIGHTING IN KILLZONE 3 


· Per-object light probes 

. Lightmaps 

· Need nice unwrapped Us 

· Static objects only 

· Level changes break lighting 

· Wasteful 

. We measured render times in days 
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LIGHTMAPS 
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LIGHTMAPS 
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INDIRECT LIGHTING ІМ KZ: SF 


· Decided to use light probes 

· Static and dynamic geometry supported 

· Works after level changes 

· Scalable 

‚ Applied per pixel 

· Deferred pass 

· Works on large objects 

. Uniform look for static and dynamic objects 
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. Voxelize the scene 


. 1-2m in gameplay areas 
. 10m in background 


Place light probes 


In empty voxels 
Next to features 


Build tetrahedron structure 
‘Light probe interpolation using tetrahedral tessellations 
Tends to generate “slivers” 


„Ада fill probes 
‚In empty space 
· Lower frequency 
· More uniform tetrahedrons 
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LIGHT PROBE SYSTEM DETAILS 


. Few hundred thousand probes per section 
‚Рег pixel search during lighting 

· Tetrahedrons partitioned into a sparse grid 
· 16m? per cell 

. BSP tree per grid cell 
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Light leaking problematic 

Store optional data in tetrahedrons 

Up to 3 occlusion planes 

Up to 4 occlusion shadow maps 
One per triangular tetrahedron side 
15 samples per map 


RESULTS 


Tech became available very late 
· Too risky to switch 

‚Used for all dynamic objects 

· Used outside gameplay areas 
. Saved 500mb per section 

. Only few levels lit exclusively by probes 
· Most levels still use light maps 

‚In use for our next game 
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PARTICLE LIGHTING 


. Particle lighting so far 
· Mostly unlit 
· Forward rendering 
. Performance and feature limitations 
. Particles need to fit our environments 
. Lighting matching the rest of geometry 
. Support for all our light types 
‚ Shadows 
. Performance is important 
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DEFERRED PARTICLE LIGHTING 


. G-Buffer for particle data 
‚Small footprint 
· Position, Normal, Depth, Accumulated lighting 
· Flat data array 
. Store several reference points per particle 
‚8х8, 4x4, 2x2 or 1x1 
. Artist chosen based on size 
. Normals bent outwards 
. Initialize with IBL lighting 
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DEFERRED PARTICLE LIGHTING 


‚Integrated into regular lighting pass 

· Runs after each on-screen light 

· Allows to reuse shadow maps 

. Final lighting available in particle shaders 
· Drive transparency based on lighting 

. Used for fog or dust 
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DEFERRED PARTICLE LIGHTING 


‚ Pros 

· Generic framework - works for any point in space 
· Builds on strengths of deferred rendering 

· Support all current and future lighting features 

. Cons 

. G-Buffer size limits particle count 

. Interpolation can be visible 
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SHADOW RENDERING OPTIMIZATIONS 


. Shadow map rendering turned out to be slow 
Up to 60% of lighting budget 

. 5000+ drawcalls, ^3 million triangles 

· Tens of shadow casting lights 

· Four sunlight shadow cascades 

· Discovered late in production 

. Cannot optimize art 

. Cannot reduce lighting quality 
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LOCAL LIGHT SHADOW OPTIMIZATIONS 


. Offline generated shadow proxies 

. Static lights and geometry 

‚Only polygons affecting shadow map 
. 60-8096 triangle reduction 

‚Single drawcall per light 

. Dynamic objects rendered separately 
. Б00К triangles 
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LOCAL LIGHT SHADOW OPTIMIZATIONS 
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SUN SHADOW OPTIMIZATIONS 


· Proxy mesh alone does not work for sunlight 
Too many triangles 

. Too large 

· Hybrid approach 

· Baked shadow map 

. Proxy delta mesh 
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SHADOW МАР OPTIMIZATIONS 


‚ Pros: 
. Significant CPU and GPU cost reduction 
. Cheap long distance sun shadows 
. 3 and 4" cascades only use shadow тар 
‚ Cons: 
. Memory cost 
. Breaks on level geometry change 
. Offline process costs time 
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VOLUMETRIC, LIGHTING & EFFECTS 
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VOLUMETRIC LIGHTING 


‚Опе of the most important ingredients of KZ:SF look 
‚Implemented as straightforward view space raymarching 
. Support for all light configurations 
. Easily controllable cost vs. quality IQ - Not worth sampling here 
. Part of deferred lighting pass 

. Rendered at half resolution 

. Bilateral upscale to full resolution 


VOLUMETRIC LIGHTING 


· Raymarch step offset by random value 
, Increased perceived quality 
· Bilateral blur removes the dither pattern 
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SCATTERING AMOUNT BUFFER 


· Plain volumetrics look bland 
· Particle systems can add structure 
· Complete artist contro! 
· Reacts to physics, player movement, wind forces 
. Particles rendered into 3D Scattering Amount Buffer 
. Affects intensity of raymarch samples 
. 1/87 of native resolution, 16 depth slices 
. Camera space, quadratic depth distribution 
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VOLUMETRIC COMPOSING 
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Incorrect Correct 
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VOLUMETRIC COMPOSING 
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Incorrect Correct 
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VOLUME LIGHT INTENSITY BUFFER 


. Composing with transparencies is problematic 
. Solved by 3D Volume Light Intensity Buffer 
· Similar idea to Scattering Amount Buffer 
· Half resolution to match volumetrics 
· Amount of visible volumetrics after ray marching 
· Between camera and given depth slice 
· Includes shadows, light attenuation and textures 
. GPU Pro 5 - ‘Volumetric Light Effects in Killzone Shadow Fall 
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TEMPORAL REPROJECTION 


. Consecutive frames are usually very similar 
· Regular rendering is wasteful 
· Render image and throw it away 
. Previous frames can improve the next 
‚Increase visual quality 


. Decrease cost of rendering 
AAA AAA AAA 


VOLUMETRIC REPROJECTION 


· Increased quality without extra raymarch samples 
· Reuse previous volumetric buffer 

. Decide on color and depth similarities 

· result = lerp(current, previous, 0.5*saturate(similarity)) 
. Change raymarch offset every frame 

. Alternate between two configurations 

. Effectively doubles the sample count“ 


* Your mileage may vary, might contain traces of nuts Killzone Shadow Fall / GDC 2014 


TEMPORAL STABILITY IN POST PROCESSING 


· Post processing benefits from temporal reprojection 
· Mostly rendered at lower resolution 

· Sensitive to undersampling or rasterization artifacts 

· Smoother motion 

· Bloom 

‚Screen Space Ambient Occlusion 

. Godrays 

· Exposure measurement 
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ction disabled Reprojection enabled 


DUST AND RAIN 


. Shader effects created by FX artists 
. Designed completely in nodegraph editor 
- Fullscreen passes modifying g-buffer 
. React to bullet decals or footsteps 
. Decals write to "user" channel of our g-buffer 


. Top-down variance shadow map used 
. Limit rain to outdoors 
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REFLECTIONS OVERVIEW 


· Real-time raytrace system 
· Dynamic reflections, multiple distances 
‚Static localized cubemap zones 
· Local reflections 
· Static background cubemap 
· Far away reflections 
· Each stage falls back to next one on miss 
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LOCALIZED LUBEMAPS 


. The zones are placed by artists 
. Two pass cubemap rendering 
. Clean render with reflections disabled 
· Secondary bounces with reflections enabled 
· Rendering takes an hour per section 
. Mipmap filtering matches BRDF specular cone 
. “Local Image-based Lighting With Parallax-corrected Cubemap 
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ULOSSINESS 


. Driven by surface roughness апа reflection ray length 
· Affect reflection cone aperture and radius 
· Determines cubemap mip selection 
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REAL-TIME REFLECTIONS 


. Screen space ray-tracing 
‚ Stages 
· Ray-tracing 
· Filtering and reprojection 
· Composing with cubemaps 
‚ Half resolution 
· Pick different pixel from 2x2 quad every frame 
· Cover full resolution after 4 frames 
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RAY-TRACE 


‚ Constant step іп screen ХУ 

· Smoother surfaces have smaller step 

· Reflection vector dependent 

· Ray passes under weapon 

· Hit depth interpolated from last two depths 
· Reproject hit color from last frame 

· Secondary bounces! 

. Output - hit color / hit mask / glossiness 
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FILTERING AND REFLECTION 


„аепегаје mip chain from ray-trace results 
· Matches BRDF just like cubemaps 
· Use mask to discard ‘miss’ pixels 
· Not depth aware! 
· Build the reflection buffer 
. Use gloss buffer to pick mipmap 
· Мр does match the cone radius 
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STABILIZATION AND REPROJECTION 


Alternating samples need stabilization 
· Temporal reprojection supersampling filter 

· Blend with history if colors are similar 

. Use reflection neighborhood color range 

. “Real-Time Global Illumination and Reflections in Dust 514 
. Compose with cubemaps 

· Ray-trace mask used for blending 
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ANTI-ALIASING 


Originally went for MSAA 

. With temporal reprojection for better quality 
‚Implementation started very late 

. Other features took priority 

. Launch-title ‘noob’ mistake 
. Introduced small performance hit 

. Game assets already balanced 

. No time to find extra GPU performance 
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TEMPORAL ANTI-ALIASING 


· Temporal reprojection + FXAA 

· Мо MSAA 

· Better image stability 

. Accumulate pixels into history buffer 

. Contains roughly 16 frames worth of data 
. Uses color similarities criteria 

· Experimented with sub-pixel jitter 
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Numerical diffusion is a problem 
Image gets blurry with reprojection 
Usually invisible with MSAA 

Use back and forth error 

compensation and correction method 


"Ап Unconditionally Stable MacCormack 
Method 


Image by Andrew Selle 


MULTIPLAYER RENDERING 


TEMPORAL 1080P 


. Single player targets 1080p 30 fps 

‚ Multiplayer targets 1080p 60 fps 

· Faster responses 

· Smoother gameplay 

. Did not want to downsize the content 
· Multiplayer needs to look next-gen 

· No time to create optimized assets 

· Tech solution needed 
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TEMPORAL 1080P 


· Needed 100% speedup 

· But not lower quality 

- Reprojection can help here 

. Render buffers at 960x1080 

. Alternate rendering of odd/even pixels 

. Use reprojection to build 1920x1080 frame 

‚ Results hard to distinguish from 1080p single player 
. Usually 80% performance gain 
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TEMPORAL 1080P 


. Keep two previous half-frames 
» Use double reprojection rame N-2 - 960x rame N-1 - 960x ETE 


‚Check similarity of М and N-2 | ці | 
. Color neighborhood similarity 
. Motion continuity 

. Accept pixel N-1 for similar 


frames 
. Otherwise just interpolate from М ки. 


Frame М - 1920х1080 


Killzone Shadow Fall / СОС 2014 


TEMPORAL 1080P 


. Keep full-resolution history buffer 
. Only reproject in safe case 

· Motion 15 coherent 

. Colors are similar 

. Adds extra image stability 


Frame N-2 - 960x1080 Frame N-1 - 960x1080 Frame М - 960x1080 


History М-1 - 1920x1080 Frame N - 1920x1080 
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THE END / QUESTIONS? 


· Recap: 
· Physically correct lighting is a big step, go the full distance. 
. Don't let ће lightmaps disappoint you, fight back. 
It is worth investing into particle lighting and volumetrics. 
· Real-time reflections are the next thing. 
· Reproject all the things! 


Special thanks: Andreas Varga / Guido de Haan / Hugh Malan / 
Jaap van Muijden / Jeroen Krebbers / Kenzo ter Elst / 
Michal Drobot / Michiel van der Leeuw / Nathan Vos / Will Vale 
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FORCEFIELDS 


‚ Art-driven force simulation framework 

. Several area affecting primitives 

· Wind box, explosion, vortex 

· Statically placed 

‚ Attached to entities or player 

· Focus on complete art-direction control 
‚ Affects cloth, particles and shaders 
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FORCEFIELDS 


. Calculation is running as compute job 
. 60,000 points sampled each frame 
- Explicit queries return forces for specific points 
. Used for cloth simulation or particles 
· Forces cached in grid around the player 
. Grids - 16x16x16x25cm, 32x32x32x1m, 16x16x16x2m 
. Data available in shaders 
. Used for foliage, tarps or water surface 
. Includes spring solver with few elasticity presets 
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ТЕХТОВЕ STREAMING 


Killzone З prioritized streaming with bounding boxes 
· Does not work inside buildings 

‚Shadow fall needs 10+GB RAM without streaming 

· Have to stream almost all mipmaps 

Р54 GPU can report mipmap usage 

· No change to shaders needed 

· Precise estimation for texture streaming 

. Works well with complicated shaders 
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